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OPTICAL DEVICE 
Michael D. GOLDSTEIN, Avi YARON and Shay GHILAI 



FIELD OF THE INVENTION 

The present invention relates to endoscopes, microscopes and 
horoscopes, in generai and to stereoscopic image pick up devices with 
color imaging capability, in particular 

BACKGROUND OF THE INVENTION 

Stereoscopic image detection devices are known in the art. Such 
devices are required to obtain and provide a combination of small cross 
section and high image quality. It will be appreciated by those skilled in the 
art that high image quality, in general, is characterized by stereoscopic 
vision accuracy, color capabilities, high resolution and illumination 
requirements. 

It is noted that conventional methods, which provide 
stereoscopic images, require a wider optical path than a monocular one. 
Such a widened optical path enlarges the cross-section required for the 
detection device considerably. Hence, the requirement for a small cross 
section is not maintained. 

US Patent No. 5,527,263 to Jurgen, is directed to a dual optical 
path stereo endoscope with simple optical adjustment. US Patent No. 
5,776,049 to Takahashi, is directed to a "Stereo Endoscope in Stereo 
Endoscope Imaging Apparatus" and provides a device which utilizes a 
combination of two optical paths with two CCD units, capable of variable 
zoom. 

Auto-stereoscopic devices, which utilize one optical system to 
provide a stereo effect, are also known in the art. Such a device is 
provided in US patent No. 5,603,687 to Hori, which is directed to a device 
with two parallel optical axes and two CCD elements. Hori selected an 



asymmetrical approach, wherein one optical cliannel lias a large aperture 
for light and details, and the other optical channel provides a parallax 
image for stereoscopic Imagery to the proximal CCD. 

US patent No. 5,613,936 to Czarnek, is directed to a 
stereoscopic endoscope device which utilizes light polarization and time 
multiplexing, in order to transmit each different polarized image 
corresponding to left and right images multiplexed in time, through one 
optical channel that transfers images from the lateral side of the 
endoscope shaft. This endoscope has to be Inserted deeper into the 
human cavity to receive a stereo image. It must also be used with a head 
mounted display device called "switched shutter glasses" that causes eye 
imtation. It is noted that according to Czarnek each image is received in 
25% of original quality. As much as 50% of the light received from the 
object, is lost due to polarization considerations and as much as 50% of 
the remaining Information is lost due to channel switching. 

US patent No. 5,588,948, to Susumu, is directed to a 
stereoscopic endoscope. The stereo effect is produced by having a 
dividing pupil shutter, which splits the optical path onto the left and right 
sides, and the up and down sides, These sides are alternately projected 
on a proximal image pick up device, using time multiplexing. According to 
another aspect of this reference a distal CCD is included, which is divided 
to left and right sides with a shading member separating them, for 
achieving space multiplexing. 

U.S. patent No. 5,743,847 to Nakamura et al., is directed to a 
"Stereoscopic Endoscope Having Image Transmitting Optical-System and 
Pupil Dividing Unit that are Axiaily Movable With Respect to Each Other",- 
which uses a plural pupil dividing means and one optical channel. U.S. 
patent No. 5,751,341 to Chaleki et al, is directed to a "Stereoscopic 
Endoscope System", which is basically a two channel endoscope, with one 



or two proximal Image sensors. A rigid sheath with an angled distal tip 
could be attached to its edge and be rotated, for full view. 

U.S. Patent No. 5,800,341 to Mckenna et al., is directed to an 
"Electronically Steerable Endoscope", which provides different fields of 
5 view, without having to move the endoscope, using a plurality of CCD cells 
and processing means. U.S. Patent No. 5,825,534 to Strahle, is directed 
to a "Stereo Endoscope having a Folded Sideline Sight Line" including 
stereo-endoscope optical channel, having a sight line folded relative to 
tube axis. 

10 U.S. Patent No. 5,828,487 to Greening et al., is directed to a 

"Stereoscopic Viewing System Using a Two Dimensional Lens System" 
which in general, provides an alternative R-L switching system. This 
system uses a laterally moving opaque leaf, between the endoscope and 
% the camera, thus using one imaging system. US patent No. 5,594,497 to 
5 15 Ahern, describes a distal color CCD, for monocular view in an elongated 

iU The above descriptions provide examples of auto-stereoscopic 

T inventions, using different switching techniques (Time division 
multiplexing) and polarization of channels or pupil divisions (spatial 
ji' 20 multiplexing), all in an elongated shaft. When color image pick up devices 
0 are used within these systems, ttie system suffers from reduced 
resolution, loss of time related Information or a widened cross section. 

The issue of color imagery or the Issue of a shaft-less 
endoscope Is not embedded into any solution. 
25 To offer higher flexibility and to reduce mechanical and optical 

constraints it is desired to advance the image pick-up device to the frontal- 
part of the endoscope. This allows much higher articulation and lends itself 
easily to a flexible endoscope. Having a frontal pick up device 
compromises the resolution of the color device due to size constraints (at 
30 this time). 



-3- 



us patent No. 5,076,687 to Adelson, is directed to an "Optical 
Ranging Apparatus" which is, In general a depth measuring device utilizing 
a lenticular lens and a cluster of pixels. 

U.S. patent No. 5,760,827 to Paris, is directed to "Pixel Data 
Processing System and Method for Producing Spectrally-Multiplexed 
Images of Three-Dimensional Imagery for Use in Stereoscopic Viewing 
Thereof and demonstrates the use of multiplexing in color and as such, 
offers a solution for having a color stereo imagery with one sensor. 
Nevertheless, such a system requires several sequential passes to be 
acquired from the object, for creating a stereo color image. 

US patent no. 5,812,187 to Akira, is directed to an Electronic 
Endoscope Apparatus. This device provides a multi-color image using a 
monochromatic detector and a mechanical multi-wavelength-iiluminating 
device. The monochromatic detector detects an Image, each time the 
multl-wavelength-lllumlnating device produces light at a different 
wavelength. 



SUMMARY OF THE PRESENT INVENTION 

It is an object of the present invention to provide a novel system 
for stereoscopic imaging using a lenticular lens layer and a sensor array, 
and a novel method for operating the same, which overcomes the 
5 disadvantages of the prior art. 

In accordance with the present invention, there is thus provided 
a stereoscopic device, which includes a lenticular lens layer and a color 
light sensor an-ay. The lenticular lens layer includes a plurality of lenticular 
elements. Each of the lenticular elements is located in front of a selected 
10 group of the light sensors of the sensor array, thereby directing light from 
different directions to different light sensors within the selected group of 
the light sensors. 

In accordance with a further aspect of the invention, there is 
;^ provided a stereoscopic device, which includes a lenticular lens layer and 
5 15 a light sensor array, Including a plurality of light sensors, where each of the 
a light sensors detects light at a predetermined range of wavelengths, 
iij The stereoscopic device according to the invention can be 

J constructed as a large-scale device, such as a television camera or a 
;!j small-scale device such as sin endoscope. 

y 20 In a stereoscopic device' according to the invention, each of the 

□ lenticular elements includes light directing means, which distinguish 
between at least two directions of light. For example, each of the lenticular 
elements can be shaped in a general semi-cylindrical shape. Each of the 
lenticular elements can alternatively include light directing means, which 
25 distinguish between four directions of light. For example, such a lenticular 
element can be shaped in a general semispherical shape. 

According to one aspect of the invention, each of the selected 
groups of the light sensors includes an even number of light sensors. 
According to another aspect of the invention, each of the selected groups 
30 of the light sensors includes an odd number of light sensors. 
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The stereoscopic device of the invention can further include an 
illuminating unit. This light Illuminating unit can surround the lenticular lens 
layer. An illumination unit according to the invention includes a light 
source, a light distribution unit and light guiding means connected between 
6 the light source and the light dispersing unit. The light guiding means 
guides light from the light source to the light dispersing unit. According to 
one aspect of the invention, the light dispersing unit surrounds the 
lenticular lens layer. 

The light illuminating unit can produce light in a predetermined 
10 range of wavelengths. According to another aspect of the invention, the 
light Illuminating unit produces at least two alternating beams of light, 
where each of the beams of light is characterized as being in a different 
range of wavelengths. 

The stereoscopic device according to the invention, can further 
^ 15 include a controller connected to the array of light sensors. This controller 
^fl produces an image for each of the different directions, by combining data 
iij received from the light sensors respective of each of the different 
directions^ 

This controller can be connected to the array of light sensors. 
w 20 Accordingly, the controller produces an image for each combination of a 
ri selected one of the different directions and a selected one of the beams of 
light, by combining data received from the tight sensors respective of each 
of the different directions, with respect to the currently illuminating one of 
the beams of light. 

25 The stereoscopic device according to the invention can further 

include capturing means, connected to the array of light sensors, for 
capturing data received from light sensors and a storage unit for storing 
the captured data. The stereoscopic device can further include a 
stereoscopic display unit, connected to the controller, for producing the 
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image in a stereoscopic manner. The produced Image can be partially 
stereoscopic. 

The predetermined ranges of wavelengths, which are applicable 
for the light sensors as well as for the illumination light beams can be 
6 selected from the list consisting of substantially visible red color light, 
substantially visible green color light, substantially visible blue color light, 
substantially visible cyan color light, substantially visible yellow color light, 
substantially visible magenta color light, substantially infra-red light, 
substantially ultra-violet light, visible light, and the like. 
10 For example, either the light sensor an^ay or the light beams can 

include a color combination of red-green-blue (RGB), 
cyan-yellow-magenta-green (CYMG), a white light color combination and 
the like. 

In accordance with a further aspect of the invention, there is thus 
15 provided a method for detecting a stereoscopic image. The method 
includes the steps of splitting light which arrives from different directions, 
using a lenticular lens layer, thereby producing at least two images, which 
are intertwined in a master image, and detecting the master image. 

The method can further include the step of reconstructing each 
20 of the images from the master image. In addition, the method can further 
include the step of displaying the images using a stereoscopic display 
device. 

Furthermore, the method can include the step of simultaneously displaying 
the images on a stereoscopic display device. In addition, the method can 
25 further include the steps of sequentially illuminating a detected area with 
alternating beams of light, of different ranges of wavelength, and 
associating the master image in time, with the currently illuminating ranges 
of wavelength. 

The step of reconstructing can Include the steps of determining a range of 
30 wavelengths for each pixel within each one of the images, and determining 
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an intensity level for each pixel within each one of the images. The step of 
reconstructing can further include the steps of selecting one of the pixels, 
associated with a predetermined range of wavelengths, determining the 
pixels associated with another range of wavelengths, in the vicinity of the 
5 selected pixel, calculating an approximated level of the other range of 
wavelengths at the location of the selected pixel, and starting again from 
the step of selecting. 

In accordance with another aspect of the present invention, there is 
thus provided a stereoscopic device for detecting a stereoscopic Image. 
10 The stereoscopic device includes at least two apertures, a multi 
wavelength light sensor array and a controllable multi wavelength 
Illumination unit. Each aperture includes a plurality of light valves. The 
controllable multi wavelength illumination unit produces at least two 
y alternating beams of light, where each beam of light is characterized as 
^5 15 being in a different range of wavelengths. Each light valve Is operative to 
fl open at a different predetermined timing. Furthermore, the multi 

m wavelength light sensor array defects a plurality of images, where each of 

f the images corresponds to a predetermined combination of an open state 

•J of a selected light valve and' a selected mode. 

^ti 20 In accordance with a further aspect of the present invention, 

a there is thus provided a method for detecting a stereoscopic image. The 
method includes the steps of alternating between at least two apertures, 
producing a sequence of at least two illumination beams and detecting a 
plurality of frames. The apertures are directed at an object, The 
25 illumination beams are produced in different ranges of wavelengths, Each 
of the frames is detected for a combination, which includes a selected- 
aperture iand a selected illumination beam. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be understood and appreciated more 
fully from the following detailed description taken In conjunction with the 
drawings in which; 

Figure 1 Is a schematic illustration of a Uiree dimensional object 
and a stereoscopic vision apparatus, constructed and operative In 
accordance with a preferred embodiment of the present invention; 

Figure 2 is a schematic Illustration of a stereoscopic vision 
apparatus, constructed and operative In accordance with another preferred 
embodiment of the present invention; 

Figure 3A Is a schematic illustration of a super-pixel, constructed 
and operative in accordance with a further preferred embodiment of the 
present invention; 

Figure 3B Is a schematic Illustration of the super-pixel of Figure 
3A and a lenticular element, constructed and operative in accordance with 
a another preferred embodiment of the present Invention; 

Figure 3C is a schematic illustration of a sensor array and a 
lenticular' lens layer, constructed and operative in accordance with a 
further preferred embodiment of the present invention; 

Figure 4 is a schematic illustration of a super-pixel, constructed 
and operative in accordance with another preferred embodiment of the 
present invention; 

Figure 6A is a schematic illustration of a color super-pixel, 
constructed and operative In accordance with a further preferred 
embodiment of the present invention; 

Figure 5B is a schematic illustration of the color super-pixel of 
Figure 5A, with a single lenticular element, constructed and operative in 
accordance with another preferred embodiment of the present Invention; 

Figure 5C is a schematic illustration of the color super-pixel of 
Figure 5A, combined with three lenticular elements, constructed and 



operative in accordance with a further preferred embodiment of the 
present invention; 

Figure 6 Is a schematic illustration of a sensor array and a 
lenticular lens layer, constructed and operative in accordance with another 
preferred embodiment of the present Invention; 

Figure 7A is a schematic illustration of method for operating the 
apparatus of Figure 2, operative in accordance with a further preferred 
embodiment of the present Invention; 

Figure 7B is an illustration in detail of a step of the method of 
Figure 7A; 

Figure 7C is a schematic illustration of a sensor array and a 
lenticular lens layer constructed and operative in accordance with another 
preferred embodiment of the present Invention; 

Figure 8 is a schematic illustration of a stereoscopic vision 
apparatus, constructed and operative in accordance with a further 
preferred embodiment of the present invention; 

Figure 9A is a view in perspective of a section of light sensors, 
and a lenticular element, constructed and operative in accordance with 
another preferred embodiment of the present invention; 

Figure 9B is a view from the bottom of the lenticular element and 
the section of light sensors of Figure 9A; 

Figure 9C is a view from the side of the lenticular element and 
the section of light sensors of Figure 9A; 

Figure 10 is a view in perspective of a section of light sensors, 
and a lenticular element, constructed and operative in accordance with a 
further preferred embodiment of the present invention; 

Figure 1 1 Is a view in perspective of a sensor array and a 
lenticular layer, constructed and operative in accordance with another 
preferred embodiment of the present invention; 
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Figure 12A is a schematic illustration of a detection apparatus, 
constructed and operative in accordance with a further preferred 
embodiment of the present invention; 

Figure 12B is another schematic Illustration of the detection 
apparatus of Figure 12A; 

Figure 13 is a schematic illustration of a detection apparatus, 
constructed and operative in accordance vAth another preferred 
embodiment of the present invention; 

Figure 14A is a partially schematic partially perspective 
illustration of a combined illumination and detection device, constructed 
and operative in accordance with a further prefen'ed embodiment of the 
present invention; 

Figure 14B is a partially schematic partially perspective 
illustration of the combined illumination and detection device of Figure 
14A, a controller and output frames, constructed and operative in 
accordance with another preferred embodiment of the present invention; 

Figure 15 is an illustration in perspective of a color illumination 
unit, constructed and operative in accordance with a further preferred 
embodiment of the present invention; 

Figure 16 is a view in perspective of a sensor array and a partial 
lenticular layer, constructed and operative in accordance with another 
preferred embodiment of the present invention; 

Figure 17 is a view in perspective of a sensor array and a partial 
lenticular layer, constructed and operative in accordance with a further 
preferred embodiment of the present invention; 

Figure 18 is a schematic illustration of a sensor array and a' 
partial lenticular layer, constructed and operative in accordance with 
another preferred embodiment of the present invention; 
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Figure 19 is a schematic illustration of a sensor an-ay and a 
partial lenticular layer, constructed and operative in accordance with a 
further preferred embodiment of the present Invention; 

Figure 20A is a schematic illustration of a system, for producing 
a color stereoscopic image, in a right side detection mode, constructed 
and operative in accordance with another preferred embodiment of the 
invention; 

Figure 20B is an illustration of the system of Figure 20A, in a 
left-side detection mode; 

Figures 21A and 21 B are schematic illustrations of timing 
sequences, in which the controller of the system of Figure 20A 
synchronizes the operation of illumination unit, apertures and image 
detector of that same system; 

Figure 22 is a schematic illustration of a method for operating 
the system of Figure 20A and 20B, operative in accordance with a further 
preferred embodiment of the present invention; 

Figure 23 a schematic illustration of a timing scheme, for 
operating'the system of Figures 20A and 208, in accordance with another 
preferred embodiment of the present invention; and 

Figure 24 a schematic illustration of a timing scheme, for 
operating the system of Figures 20A and 208, in accordance with a further 
preferred embodiment of the present invention. 
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DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

The present invention overcomes the disadvantages of the prior 
art by providing a continuous vision stereoscopic apparatus, using a 
generally lenticular lens layer, a light sensor array and an image 
processing system. 

Reference Is now made to Figure 1 , which is a schematic illustration of a 
three dimensional object and a stereoscopic vision apparatus, generally 
referenced 1 00 constructed and operative in accordance with a preferred 
embodiment of the present invention. Apparatus 100 includes a lenticular 
lens layer 104, a light sensor array 102, a processor 106 and two display 
devices 108R and 108L. Apparatus 100 Is placed in front of a 
three-dimensional object 1 50. An optical assembly 1 52 is placed between 
apparatus 100 and object 150, for focusing the image of object 150 on 
light sensor array 102. 

Light sensor array 102 includes a plurality of sensors 110, 111, 
112. 113. 114, 115, 116, 117, 118 and 119. Lenticular lens layer 104 
includes a plurality of lenticular elements 130, 132, 134, 136 and 138. 
Each one' of the lenticular elements is located above two light sensors, in a 
way that lenticular element 130 is located above sensors 110 and 111, 
lenticular element 132 is located above sensors 112 and 113, lenticular 
element 134 is located above sensors 1 14 and 115, lenticular element 136 
is located above sensors 116 and 117 and lenticular element 138 is 
located above sensors 118 and 119. 

The light sensors 110, 111, 112, 113, 114, 115, 116, 117, 118, 
and 119, detect light as directed by the lenticular lens elements 130, 132, 
134, 136 and 138, and provide respective information to the processor 
106. The processor 106 processes this information, produces a pair of 
images, as will be explained in detail hereinbelow, and provides them to 
the display units 108R and 108L, which in turn produce visual 
representations of these images, 
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In general, each lenticular element directs light rays, which arrive 
from a predetermined direction to a predetermined location, and light rays 
which arrive from another predetermined direction, to another 
predetermined location. Hence, the present invention, utilizes the lenticular 
5 lens layer to distinguish between a right view image and a left view image, 
as IS described hereinbelow. 

Each of the display units 108R and 108L includes a plurality of 
display units also known as pixels. Display unit 108L includes pixels 142A, 
142B, 142C, 142D and 142E. Display unit 108R includes pixels 144A, 
10 144B, 144C, 144D and 144E. Using these pixels each of the display units 
produces an image, according to data provided from the processor 106. 
The two images, each viewed by a different eye of the user, produce a 
sensation of a three dimensional image. 
:^ Light rays 124A, and 126A represent a right-side image of the 

^ 15 three-dimensional object 150, Light rays 120A. and 122A represent a left 
0 side Image of the three-dimensional object 150. The optical assembly 152 
jij redirects light rays 120A, 122A, 124A and 126A so as to focus them on a 

f plain which is determined by the light sensor array 102, as light rays 120B, 

g 122B, 124B and 126B, respectively. Hence, Light rays 122B and 126B 

y 20 represent a focused left side view of the three-dimensional object 1 50, and 
□ light rays 120B and 124B represent a focused right side view of the 

three-dimensional object 150. 

The lenticular lens layer 1 04 directs the focused left side view 
light rays 122B and 126B to light sensors 110 and 118, respectively, as 
25 respective light rays 122C and 126C, In addition, the lenticular lens layer 
104 directs the focused right side view light rays 120B and 124B to light 
sensors 111 and 119, respectively. In general, light sensors 111, 113, 115, 
117 and 119 detect light rays which relate to a right side of view image of 
object 150, and light sensors 110, 112, 114, 116, and 118, detect light 
30 rays which relate to left side view Image of object 1 50. 
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Hence, light sensors 110, 112, 114, 116 and 118 detect the left 
side image of object 150, while light sensors 111, 113. 115, 117 and 119 
detect the right side Image of object 150. The light sensor array 102 
provides data relating to the detected light Intensity at each of the tight 
sensors to the processor 1 06. 

The processor processes this data, produces a right side image from the 
data relating to the right side image and a left side image from the data 
relating to the left side, and provides the respective image to the 
respective display unit 108R and 108L. In the present example, the 
processor 106 utilizes the data received from sensors 110, 112, 114, 116 
and 118 to determine the data provided to pixels 144A, 144B, 144C, 144D 
and 144E. Similarly, the processor 106 utilizes the data received from 
sensors 111, 113, 115, 117 and 119 to determine the data which is to be 
provided to pixels 142A, 142B, 142C, 142D and 142E. 
According to the present invention, the right side image and the left side 
image are detected at the same time and hence, can also be displayed at 
the same time. According to another aspect of the present invention, each 
of the IrgKt sensors 110, 111, 112, 113, 114, 115, 116, 117, 118, and 119, 
includes a plurality of color sensing elements, which together cover a 
predetermined spectrum, as will be described in detail herein below. 

Reference is now made to Figure 2, which is a schematic 
illustration of a stereoscopic vision apparatus, generally referenced 200 
constructed and operative in accordance with another preferred 
embodiment of the present invention. Apparatus 200 includes a sensor 
assembly 202, an interface 210, a processor 208, a movement detector 
230, a light source 206, a memory unit 204, a stereoscopic video- 
generator 212 and a stereoscopic display 214. The sensor assembly 202 
is connected to the interface 210 using a flexible cord 218. The interface 
210 is connected to processor 208, memory unit 204, and the light source 
206. The processor 208 is further connected to the memory unit 204, 
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movement detector 230 and to the stereoscopic video generator 212. The 
stereoscopic video generator 212 is further connected to the stereoscopic 
display 214. Movement detector 230 detects the movement of sensor 
assembly 202 relative to an object. For this purpose, movement detector 
230 is attached to sensor assembly 202. In the case of a rigid endoscope, 
the movement detector can be attached to any part of the endoscope rod, 
since the movement of the endoscope head can be determined according 
to the movement of any point of the endoscope rod.. The operation of 
system 200, according to data received from movement detector 230, is 
described herein below. 

The sensor assembly 202 includes a focusing element, which in 
the present example is a lens 226, a lenticular lens layer 222, a light 
sensor array 220, an interface 228 and a light projecting means 224. The 
lenticular lens layer 222 is attached to the light sensor array 220. 
According to the invention, the light sensor array 220 can be any type of 
sensing array, such as a CCD detector, a CMOS detector, and the like. 
The light sensor array 220 is connected to the interface 228, which can 
also acts as a supporting base. 

The stereoscopic display 214 includes two display units, a left 
display unit 216L (for placing in front of the left eye of the user) and a right 
display unit 21 6R (for placing in front of the right eye of the user). Hence, 
the stereoscopic display 214 is capable of displaying stereoscopic images 
continuously. Such a stereoscopic display unit is for example the ProView 
50 ST head mounted display, manufactured and sold by Kaiser 
Electro-Optics Inc., a US registered company, located in Carlsbad, 
California. Another example for a stereoscopic display unit is the virtual- 
retinal display (VRD) unit, which is provided by MICROVISION Inc., a US 
registered company, located in Seattle, Washington. It is noted that any 
method, which is known in the art for displaying stereoscopic, and for that 
matter three-dimensional images, is applicable for the present invention. 
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The image received from a three dimensional object is received 
at the sensor assembly 202, focused by lens 226 » optically processed by 
the lenticular lens layer 222 and finally detected by the light sensor array 
220. The lenticular lens layer 222 directs light coming from one 
5 predetermined direction to predetermined light sensors of the light sensor 
array 220, and light coming from another predetermined direction to other 
predetermined light sensors of the light sensor array 220. Accordingly, 
light sensor array 220 detects two images of the same object, a right side 
image and a left side Image, each from a different direction. This aspect of 
10 the invention is described in detail hereinabove, in conjunction with Figure 
1. 

An electronic representation of this information is partially processed by 
the interface 228 and then provided to the Interface 210, via flexible cord 
218. It is noted that flexible cord 218 Includes digital communication linking 

15 means such as optic fibers or electrical wires, for transferring data 
received from light sensor array 220, as well as light guiding conducting 
means for conducting light fi-om light source 206 to the light projecting 
means 2'24. According to the present invention, flexible cord 218 can be 
replaced with a rigid cord (not shpwn), if necessary. 

20 The data received at interface 210 includes Information, which 

relates to the two images and has to be processed so as to distinguish 
them from each other. As the processor 208 processes the information, it 
uses the memory unit 204 as temporarily storage. 

After processing the information, the processor 208 produces 

25 two matrixes each being a reconstructed representation relating to one of 
the originally detected images. The processor provides these matrixes to 
the stereoscopic video generator 212, which in turn produces two 
respective video signals, one for the left view image and another for the 
right view image. 
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The stereoscopic video generator 212 provides the video signals 
to the stereoscopic display 214, which in turn produces two images, one 
using right display unit 21 6R and another using left display unit 21 6L. 

It is noted that the general size of the sensor assembly 202 is 
5 dictated by the size of the sensor array and can be in the order of a few 
miJIimeters or a few centimeters. This depends on the size of each of the 
sensors in the array and the total number of sensors (i.e. the required 
optical resolution). 

According to one aspect of the invention, each of the sensors in 
10 light sensor array 220, is a full range sensor, which yields data relating to a 
gray scafe stereoscopic image. According to another aspect of the 
invention, each of the sensors in the light sensor array, can be adapted so 
as to provide full color detection capabilities. 

Reference is now made to Figure 3A, which is a schematic 
5 16 illustration of a super-pixel, generally referenced 300, constructed and 
a operative in accordance with a further preferred embodiment of the 

Fy present invention. Super-pixel 300 includes a left section of sensors which 

;^ includes 'three sensors 302, 304 and 306, and a right section of sensors 

p which also includes three sensors 308, 310 and 312. Sensors 302 and 

w 20 310 detect generally red colored light, sensors 304 and 312 detect 
o generally green colored light and sensors 306 and 308 detect generally 

blue colored light Hence, each of the sections includes a complete set of 
sensors for detecting light in the entire visible spectrum. 
Reference is further made to Figure 3B, which is a schematic illustration of 
25 the super-pixel 300 of Figure 3A and a lenticular element, generally 
referenced 318 constructed and operative in accordance with a another 
preferred embodiment of the present invention. The lenticular element 318 
is located on top of super-pixel 300, where its right side covers the right 
section of the super-pixel 300, and its left side covers the left section of the 
30 super-pixel 300. Accordingly, the lenticular element 318 directs light, which 
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arrives from the left (right view image), to the ieft section of the super-pixel 
300, where it is detected In full spectrum by sensors 302, 304 and 306. 
The data provided by these sensors can later be utilized to reconstruct an 
Image in full color. Similarly, the lenticular element 318 directs light, which 
arrives from the right (left view image), to the right section of the 
super-pixel 300, where it Is detected in full spectrum by sensors 308, 310 
and 312. 

Reference is now made to Figure 3C, which is a schematic illustration of a 
sensor array, generally referenced 330, and a lenticular lens layer, 
generally referenced 332, constructed and operative in accordance with a 
further preferred embodiment of the present invention. Sensor array 330 is 
a matrix of MxN super-pixels, which are generally referenced 340. For 
example, the upper left super-pixel is denoted 340(i.i), the last super-pixel 
in the same column is denoted 340(i,n) and the lower-right pixel is denoted 
340(M,N). A lenticular lens layer 332 of which three lenticular elements are 
shown (referenced 334), is placed over the sensor array 330. 

Lenticular element 334(i) covers the first column of super-pixels 
340 from super-pixel 340(i,i) to super-pixel 340{i,n). Lenticular element 
334(2] covers the second column of super-pixels 340 from super-pixel 
340(2,1) to super-pixel 340(2,n). Lenticular element 334(3) covers the third 
column of super-pixels 340 from super-pixel 340(3 1) to super-pixel 340(3,n). 
Accordingly, each of the lenticular elements of the lenticular lens layer 
covers an entire column of super-pixels. 

It is noted that a super-pixel according to the present invention 
can include sensors in any set of colors such as red-green-blue (RGB), 
cyan-yellow-magenta-green (CYMG), Infra-red, ultra-violet and the like, in 
any an-angement or scheme such as columns, diagonals and the like. It is 
noted that such a set of colors can be achieved either by using specific 
color sensitive detectors or by using color filters over the wide spectrum 
detectors. 
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Reference is further made to Figure 4, which Is a schematic 
illustration of a super-pixel, generally referenced 350, constructed and 
operative in accordance with another prefen-ed embodiment of the present 
invention. Super-pixel 350 includes a left section of sensors which includes 
5 four sensors 352, 354, 356 and 358 and a right section of sensors which 
also includes four sensors 360, 362, 364 and 366. Sensors 352 and 366 
detect generally cyan colored light, sensors 354 and 360 detect generally 
yellow colored fight, sensors 356 and 362 detect generally magenta 
colored light and sensors 358 and 364 detect generally green colored 
10 light. Hence, each of the sections Includes a complete set of sensors for 
detecting light In the entire visible spectrum. 

Reference is further made to Figures 5A, 5B and 5C. Figure 5A 
is a schematic illustration of a super-pixel, generally referenced 370, 
:i constmcted and operative in accordance with a further preferred 
'J 15 embodiment of the present invention. Figure 5B is a schematic illustration 
a of super-pixel 370 combined with a single lenticular element, generally 
m referenced 384, constructed and operative in accordance with another 
preferred 'embodiment of the present invention. Figure 5C is a schematic 
p Illustration of super-pixel 370 combined with three lenticular elements, 
y 20 generally referenced 386, constructed and operative In accordance with a 
o further preferred embodiment of the present invention. 

The color arrangement which is provided for super-pixel 370 is 
typical for vertical light detection arrays, where each column of sensors is 
coated witti light filtering layer of a different color. As can be seen in Figure 
25 5A, super-pixel 370 includes a plurality of light sensors 372, 374, 376, 378, 
380 and 382. Light sensors 372 and 378 are blue color range sensors. 
Light sensors 374 and 380 are green color range sensors. Light sensors 
376 and 382 are red color range sensors. 

Reference is now made to Figure 6, which is a schematic 
30 Illustration of a sensor, generally referenced 390, and a lenticular lens 

-20- 



layer, generally referenced 392, constructed and operative In accordance 
with another preferred embodiment of the present Invention. Sensor 390 is 
logically divided into a plurality of super-pixels, generally referenced 
394(x,y). For example, the upper-left super-pixel is referenced 394(i i) and 
5 the lower-right side super-pixel is referenced 394(m,n). 

As can be seen from Figure 6, the color arrangement of sensor 
390 is diagonal. Hence, each super pixel has a different color 
arrangement, and generally speaking, there are several types of 
super-pixeis, such as red-blue (super pixel 394(m-2,n)). green-red (super 
10 pixel 394(M.i.N>) and blue-green (super pixel 394<m,n)). 

Reference is now made to Figure 7A, which is a schematic 
illustration of a method for operating apparatus 200, operative in 
accordance with a further preferred embodiment of the present invention. 
In step 400, the apparatus 200 splits light which arrives from different 
5 15 directions, utilizing the lenticular lens 222. Each of the lenticular elements 
a produces two light sectors, one sector which includes light rays arriving 
iij from the left side, and another sector which includes light rays amving 
i;" from the right side. 

K In step 402, the apparatus detects each light sector separately, 

20 using a plurality of light detectors, each detecting a portion of its respective 
£= sector. With reference to Figure 3B, sensors 302, 304 and 306 detect light 
which arrives from the lenticular element 31 8, at the left side sector and 
sensors 308, 310 and 312 detect light which arrives from the lenticular 
element 31 8, at the right side sector. Each of the sensors detects light at a 
25 sub-sector. 

In step 404, the apparatus 200 determines the light characteristics as- 
detected by each of the light sensors, at each of the sub-sectors. In step 
408, the apparatus 200 utilizes the data, which was accumulated from 
selected sub-sectors to determine and produce an image representing a 
30 view from one side. In step 406, the apparatus 200 utilizes the data, which 
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was accumulated from other selected sub-sectors to determine and 
produce an image representing a view from another side. In step 410, the 
apparatus 200 displays both images using a continuous stereoscopic 
display device. 

According to a further aspect of the invention, Information from 
selected pixels can be used to enhance information for other pixels. For 
example, color information of pixels, which are associated with a first color 
Is used for extrapolating that color at the location of another pixel, 
associated with a second color. 

Reference is further made to Figures 7B and 7C. Figure 7B is an 
illustration in detail of step 406 of Figure 7A. Figure 7C is a schematic 
illustration of a sensor array, generally referenced 450, and a lenticular 
lens layer, generally referenced 452, constructed and operative in 
accordance with another preferred embodiment of the present invention. 
Sensor array 450 includes a plurality of pixel sensors, referenced 454, 
each associated with a selected color. For example, pixel sensors R(i,i), 
R{2,2). R(3.3). R<4,4), R{1,4) and R(4,i) are associated with the red color. Pixel 
sensors 'G^2^), G{3,2), G(4.z). G{i.3) and G{2,4) are associated with the green 
color. Pixel sensors B(i,2), B(2,3), B(3,4), B(3,i) and B(4,2) are associated with 
the blue color. 

In step 420, the system, according to the invention, selects a 
pixel sensor, associated with a first color. With reference to Figure 7C, the 
selected pixel sensor according to the present example is pixel sensor 

R{3,3)- 

In step 422, the system determines pixels, associated with a 
second color, in the vicinity of the selected pixel. It Is noted that these 
pixels can also be restricted to ones, which relate to the same image side 
of the selected pixel. With reference to Figure 7C, the second color is 
green and the green pixel sensors, in the vicinity of pixel sensor R(3,z), 
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respective of the same image side are pixel sensors G(5.i), G{3,2), G(3,5), 
G(5,4), and G{i.3). 

In step 424, the system calculates an approximation of the level 
of the green color at the location of the selected pixel R^s 3). It is noted that 
5 the calculation can include a plurality of approximation procedures, such 
as calculating the weighted average level, depending on the location of 
pixel sensors G<5,1), G(3,2), G(3,6), G(5,4), and G(i,3), with respect to the 
location of the selected pixel sensor R^z.^y Similarly, blue color level at the 
location of the selected pixel sensor R(3,3), can be calculated using the 
10 information received from pixel sensors B(i,2). B(i_5), B(3,i), 6(3,4) and 6(5,3). 
Hence the present invention provides a method for enhancing picture 
resolution by means of color information interpolation, using image 
processing. 

;^ It Is noted that any of the lenticular elements is not necessarily 

^5 15 round shaped, but can be formed according to other optical structures 
*D which are based on various prism designs and the like, which provide the 
m directing of beams of light coming from different directions to different 

directions. 

:!J Reference is now made to Figure 8, which is a schematic illustration of a 

W 20 stereoscopic vision apparatus, generally referenced 500, constructed and 
B operative in accordance with a further preferred embodiment of the 

present invention. Apparatus 500 Includes a sensor assembly 502, a 
frame grabber 510, a processor 508, a light source 506, a memory unit 
504, a stereoscopic video generator 512 and a stereoscopic display 514. 
25 The sensor assembly 502 is connected to the frame grabber 510 using a 
flexible cord 518. The frame grabber 510, the processor 508, the memory 
unit 504 and the stereoscopic video generator 512 are all interconnected 
using a common bus. 

The sensor assembly 502 is generally similar to the sensor 
30 assembly 202, described herein above in conjunction with Figure 2. The 
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sensor assembly 502 includes a lens 526, a lenticular lens layer 522, a 
light sensor array 520, an analog to digital converter (A/D) 528 and light 
projecting means 524. The lenticular lens layer 522 is attached to the light 
sensor array 520. Light sensor array 520 is connected to the A/D 528; 
5 which could also act as a supporting base. The light projecting means 524 
is connected to light source 506, which provides light thereto. 

The stereoscopic display 514 includes two display units, a left 
display unit 51 6L {for placing in front of the left eye of the user), and right 
display unit 51 6R (for placing in front of the right eye of the user). Hence, 
10 the stereoscopic display 514 is capable of displaying stereoscopic images 
continuously. 

The sensor assembly 602 operates in a manner, similar to that 
of sensor assembly 202, described hereinabove in conjunction with Figure 
2. An electronic representation of this information, is provided by the A/D 

15 converter 528, after being converted into digital format. 

The information data is received by the frame grabber 510 and hence 
made available to the processor 508 via the bus. As the processor 508 
processes the information, it uses the memory unit 504 as temporary 
storage. After processing the information, the processor 508 produces two 

20 matrixes each being a reconstructed representation relating to one of the 
originally detected images. The processor 508 provides these matrixes to 
the stereoscopic video generator 512, which in turn produces two 
respective video signals, one for the left view image and another for the 
right view image. The stereoscopic video generator 512 provides the video 

25 signals to the stereoscopic display 514, which in turn produces two 
Images, one using right display unit 51 6R and another using left display 
unlt516L. 

Reference Is now made to Figures 9A, 9B and 9C. Figure 9A is 
a view in perspective of a super-pixel, generally referenced 550, and a 
30 lenticular element, generally referenced 552, constructed and operative In 
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accordance with another preferred embodiment of the present invention. 
Figure 9B is a view from the bottom of the lenticular element 552 and the 
super-pixel 550 of Figure 9A. Figure 9C is a view from the side of the 
lenticular element 552 and the super-pixel 550 of Figure 9A. 
5 The super-pixel 550 includes four sensor sections, 554, 556, 

558 and 560, arranged in a rectangular formation. The lenticular element 
552 is shaped like a dome and is basically divided into four sections, each 
facing a different one of the sensor sections 554, 556, 558 and 560. 

The super-pixel 550 and the lenticular element 552 form 
10 together, an optical detection unit, which is capable of detecting and 
distinguishing light which arrives from four different directions. The 
lenticular element 552 directs a portion of the upper-left side view of the 
detected object to sensor section 554 and directs a portion of the lower-left 
side view of the detected object to sensor section 556. In addition, the 

5 15 lenticular element 552 directs a portion of the upper-right side view of the 
detected object to sensor section 560 and a portion of the lower-right side 

iil view of the detected object to sensor section 558. 

' It Is noted that according to a further aspect of the invention, the 

% four-direction arrangement, which is described in Figures 9A, 9B and 9C 

W 20 can be used to [ogically rotate the image which is provided to the user, 
without physically rotating the device itself. At first, sensor sections 560 
and 558 are used to form the right-side image and sensor sections 554 
and 556 are used to form the left-side image. A rotation at an angle of 90° 
clockwise, Is provided by assigning sensor sections 554 and 560, to form 
25 the right side image, and assigning sensor sections 556 and 558, to form 
the left-side image. It is further noted that a rotation in any desired angle' 
can also be performed by means of a linear or other combination of sensor 
sections, when reconstructing the final images. 

Reference is now made to Figure 10, which is a view in perspective of a 
30 section of light sensors, generally referenced 570, and a lenticular 
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element, generally referenced 572, constructed and operative in 
accordance with a further preferred embodiment of the present invention. 
Lenticular element 572 Is extended to cover the entire area of the section 
of pixels, so as to enhance light transmission thereto. 
5 Reference is now made to Figure 11, which Is a view in perspective of a 
sensor array, generally referenced 580, and a lenticular layer, generally 
referenced 582, constructed and operative in accordance with another 
preferred embodiment of the present invention. The lenticular layer 582 
Includes a plurality of four direction lenticular elements such as described 
10 in Figures 9A and 10. The sensor array 580 Is logically divided Into a 
plurality of sensor sections, generally referenced 584(x,y). For example, the 
upper left sensor section is referenced 584(i,i) and the lower-right sensor 
section is referenced 584(iv(,n)- Each of the sensor sections is located, 
5 beneath a lenticular element and detects light directed thereby. 
IP 15 Reference is now made to Figures 12A and 12B. Figure 12A is a 

=Q schematic illustration of a detection apparatus, generally referenced 600, 
ill constructed and operative in accordance with a further preferred 

''^ embodiment of the present invention. Figure 12B is another schematic 

jj Illustration of detection apparatus 600, of Figure 12A. 
m 20 Detection apparatus 600 includes an optical assembly 602, a 

o lenticular layer 604 and an array of sensors 608. The detection apparatus 

600 detects images of an object 610, which includes a plurality of object 
sections 61 OA, 61 OB, 61 OC and 61 OD. 

Sensor array 608 Includes a plurality of super-pixels 608A, 
25 6088, 608C and 608D. Each of these super-pixels Is divided into a 
left-side section and a right-side section. For example, super-pixel 608A 
includes a left-side section, designated 608Al and a right-side section, 
designated 608Ar. 

The optical assembly 602 is divided into two optical sections 
30 602l and 602r, each directed at transferring an Image, which represents a 
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different side view. Optical section 602r transfers an Image, wliich is a 
view from tlie right side of object 610. Optical section 602l transfers an 
image, which is a view from the left side of object 610. 

A plurality of light rays 612, 614, 616 and 618 are directed from 
5 all sections of the object 610 to the left side of optical assembly 602 (i.e., 
optical section 602l), and are directed to the lenticular layer 604. Here, 
these rays are further directed to the left-side view associated sensor 
sections, which are sensor sections 608l {i.e., sensor sections 608Al, 
608Bl, 608Cl and 608Dl). 

10 With reference to Figure 12B, a plurality of light rays 622, 624, 

626 and 628 are directed from all sections of the object 610 to the right 
side of optical assembly 602 (i.e., optical section 602r), and are directed to 
the lenticular layer 604. Here, these rays are further directed to the 
right-side view associated sensor sections, which are sensor sections 

15 608Ar, 608Br, 608Cr and 608Dr. 

Reference is now made to Figure 13, which is a schematic 
illustration of a detection apparatus, generally referenced 630, constructed 
and operative in accordance with another preferred embodiment of the 
present invention. Detection apparatus 630 includes an optical assembly, 

20 which Is divided into four sections 632, 634, 636 and 638, a lenticular layer 
642 and an array of sensors 640. The detection apparatus 630 detects 
images of an object 648, which Includes a plurality of object sections 
648A, 648B. 6480, 648D, 648E and 648F. Light rays, which arrive from 
object 648 to any of the optical sections, are directed to a lenticular 

25 element of the lenticular layer 642, according to their origin. 

in the present example, all of the light rays 646A, 646B, 646C 
and 646D arrive from object element 648A. Each of these rays is received 
at a different optical section, Ray 646A is received and directed by optical 
section 636, ray 646B is received and directed by optical section 638, ray 

30 6460 is received and directed by optical section 634 and ray 646D is 
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received and directed by optical section 632. Each of the optical sections 
directs its respective ray to a specific lenticular element 642(i,i), at the right 
side of the lenticular layer 642. The location of lenticular element 642(i j) is 
respective of the location of the object element 648. The lenticular element 
5 642(t,i) directs each of the rays to predetermined light sensors within its 
respective super-pixel 640(i,i). 

In accordance with a further aspect of the present Invention, 
there is provided a reduced size color stereovision detection system, 
which uses time-multiplexed colored light projections, and respective 

10 time-multiplexed frame grabbing. 

Reference is now made to Figures 14A and 14B. Figure 14A is a 
partially schematic, partially perspective illustration of a combined 
illumination and detection device, generally referenced 650, constructed 
and operative in accordance with a further preferred embodiment of the 

15 present invention. Figure 14B is a partially schematic, partially perspective 
illustration of the combined Illumination and detection device 650 of Figure 
14A, a controller, generally designated 662, and output frames, 
construcfed and operative in accordance with another preferred 
embodiment of the present invention. 

20 Device 650 includes a lenticular layer 662, a full spectrum 

sensor array 654, an optical assembly 660 and an illuminating unit 656, 
surrounding the optical assembly 660. Illuminating unit 656 includes a 
plurality of illuminating elements, generally referenced 658, each being of 
a specific predetermined color. Illuminating elements 658red produce 

25 generally red light, illuminating elements 658green produce generally 
green light and illuminating elements 658blue produce generally blue light; 
It Is noted that each of the illuminating elements can be of a specific color 
(i.e., a specific wavelength), a range of colors (I.e., a range of 
wavelengths) or alternating colors. For example, a multi-color LED. 
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Each group of illuminating elements, which are of the same 
color, is activated at a different point in time. For example, illuminating 
elements 658red are activated and shut down first, illuminating elements 
658green are activated and shut down second and illuminating elements 
5 658blue are activated and shut down last. Then the illuminating sequence 
is repeated. 

With reference to Figure 14B, the controller 662 is connected to 
the sensor array 654 and the illuminating unit 656. The sensor array 654 
includes full spectrum sensors, which are capable of detecting red, green 

10 and blue light, but cannot indicate the wavelength of the detected light. 
The controller 662 associates the images, which are detected at any 
particular moment, using the sensor array 654, with the color of the 
illuminating elements, which were active at that particular moment. 

Hence, the first detected frame 664 in an Illumination sequence 

15 is considered red, since the illuminating elements which were active at that 
time, were illuminating elements 658red- Similarly, the second detected 
frame 666 In an illumination sequence is considered green, since the 
Illuminating elements, which were active at that time, were illuminating 
elements 658green- Finally, the last detected frame 668 In an illumination 

20 sequence is considered blue, since the illuminating elements, which were 
active at that time, were illuminating elements 658blue- It is noted that any 
other combination of colors is applicable for this and any other aspect of 
the present invention, such as CYMG and the like. 

Reference is now made to Figure 15, which is an illustration in 

25 perspective of a color Illumination unit, generally referenced 670, 
constructed and operative in accordance with a further preferred- 
embodiment of the present invention. Unit 670 includes a light-guiding 
element 671, which is generally shaped as an open-cut hollow cone, 
having a narrow section 674 and a wide section 672. A detection head 

30 according to the invention, such as described in Figure 2 (referenced 202), 
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can be placed within the hollow space of the light-guiding element 671. A 
multi-color light source 680 can be connected to the narrow section 674. 
Light, such as light ray 678, which is emitted from the light source 680, is 
directed via the light guiding element 671, and is projected through the 
5 wide section 672. 

According to a further aspect of the Invention, a remote 
multi-color light source 682 can be connected to the narrow section 674 
via additional light guiding members such as optic-fibers 684. Light, such 
as light ray 676, which is emitted from the light source 682, is directed via 
10 the light guiding members 684 to the narrow section 674. The light-guiding 
element 671 guides ray 676, and projects it through the wide section 672. 
This arrangement is useful when using an externai light source, which is to 
be placed outside the inspected area (for example, outside the body of the 
y patient). 

5 15 According to a further aspect of the invention, a full spectrum 

:0 illumination unit, which produces white light, is combined with a device 
jij such as sensor assembly 202 (Figure 2). 

Reference is now made to Figure 16, which is a view in 
jz perspective of a sensor array, generally referenced 700, and a partial 

Ui 20 lenticular layer, generally referenced 702, constructed and operative in 
p accordance with another preferred embodiment of the present invention. 
The partial lenticular layer 700 Includes a plurality of four direction 
lenticular elements such as described in Figures 9A and 10. The sensor 
array 700 is logically divided into a plurality of sensor sections, generally 
25 referenced 704(x,y). For example, the upper left sensor section is 
referenced 704(i i) and the lower-right sensor section is referenced- 
704(M,N)- Some of the sensor sections. In the perimeter, are located 
beneath lenticular elements and others, such as the sensor sections in the 
center rectangle, which is defined by sensor sections 704(4 3)- 704^ 6) are 
30 not. Accordingly, the sensors which are located at the center rectangle can 
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not be used to provide multi-direction {stereoscopic or quadroscopic) 
information. Instead, these sensors provide enhanced resolution 
monoscopic Information. 

Reference Is now made to Figure 17, which is a view in perspective of a 
5 sensor array, generatly referenced 720, and a partial lenticular layer, 
generally referenced 722, constructed and operative In accordance with a 
further preferred embodiment of the present invention. The partial 
lenticular layer 720 includes a plurality of four direction lenticular elements 
such as described In Figures 9A and 10. The sensor array 720 is logicaffy 

10 divided into a plurality of sensor sections, generally referenced 724(x,y). For 
example, the upper left sensor section Is referenced 724(ij) and the 
lower-right sensor section is referenced 724(m,n). Here, some of the sensor 
sections, in the center, (such as sensor section 724(4,2)) are located 
beneath lenticular elements and others, such as the sensor sections In the 

15 perimeter (such as sensor section 724(i,i)) are not. Accordingly, the 
sensors which are located at the center provide multi-direction 
(stereoscopic or quadroscopic) information and the ones In the perimeter 
provide enhanced resolution monoscopic information. 

In accordance with a further aspect of the present invention 

20 there is provided a partial lenticular layer, which includes spaced apart 
lenticular elements. Reference Is now made to Figure 18, which is a 
schematic illustration of a sensor array, generally referenced 740, and a 
partial lenticular layer, generally referenced 742, constructed and 
operative in accordance with another preferred embodirhent of the present 

25 invention. 

The partial lenticular layer 742 includes a plurality of lenticular 
elements designated 744{i), 744(2) and 744(3). Lenticular element 744(i) is 
located over the first two left columns of color sensors, generally 
designated 746(i), of sensor array 740. Hence, the information received 
30 from these first two left columns of color sensors of sensor an^y 740 
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contains stereoscopic information. The third and fourth columns of color 
sensors, generally designated 746(2), of sensor array 740 do not have a 
lenticular element located thereon, and hence, cannot be used to provide 
stereoscopic information. 
5 Similarly, lenticular elements 744(2) and 744(3) are located over 

color sensors column pairs, 746(3) and 746(5), respectively, while color 
sensors column pairs, 746(4) and 746(6) are not covered with lenticular 
elements. 

Reference is now made to Figure 19, which Is a schematic 
10 illustration of a sensor array, generally referenced 760, and a partial 

lenticular layer, generally referenced 762, constructed and operative in 

accordance with another preferred embodiment of the present invention. 

Lenticular layer 762 includes a plurality of lenticular elements, referenced 
rri 764(1), 764(2), 764(3) and 764(4), being of different sizes and located at 

5 15 random locations over the sensor array 740. It is noted that any structure 
f of partial lenticular layer is applicable for the Invention, whereas the 
py associated image processing application has to be configured according to 

the coverage of that specific lenticular layer, and address covered sensors 
% and uncovered sensors appropriately. 

W 20 In accordance with a further aspect of the present invention, 

O there is provided a system, which produces a color stereoscopic image. 
The structure of the stereoscopic device defines at least two viewing 
angles, through which the detector can detect an image of an object. 
According to one aspect of the invention, the stereoscopic device includes 
25 an aperture for each viewing angle. Each of the apertures can be opened 
or shut. The stereoscopic device captures a stereoscopic image, by 
alternately detecting an Image of an object, from each of the viewing 
angles, (e.g., by opening a different aperture at a time and shutting the 
rest) through a plurality of apertures, (at least two), each time from a 
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different aperture. The final stereoscopic image can be reconstructed from 
the images captured with respect to the different viewing angles. 

The detection of stereoscopic color image Is provided by 
illuminating the object v/lth a sequence of light beams, each at a different 
5 wavelength, and detecting a separate image for each wavelength and 
aperture combination. 

Reference is now made to Figures 20A and 20B. Figure 20A is a 
schematic Illustration of a system, generally referenced 800, for producing 
a color stereoscopic Image, in a right side detection mode, constructed 

10 and operative in accordance with a further preferred embodiment of the 
invention. Figure 20B is an illustration of the system of Figure 20A, in a 
left-side detection mode. 

System 800 includes a multiple aperture 804, a controller 834, 
an image detector 812, a storage unit 836, an image processor 838, a 

15 movement detector 814 and an illumination unit 830. The controller 834 is 
connected to the multiple aperture 804, the image detector 812, the 
storage unit 836, movement detector 814 and to the Illumination unit 830. 
The storage unit 836 Is further connected to the image processor 838. The 
multiple aperture 804 includes a plurality of apertures, generally 

20 referenced 802,, where each aperture can be activated to be open or 
closed. It is noted that when an aperture Is open it Is at least transparent to 
a predetermined degree to light, and when an aperture is closed, it 
substantially prevents the travel of light therethrough. Any type of 
controllable light valve can be used to construct each of the apertures. 

25 Movement detector 814 detects the movement of image detector 812. The 
detected movement can be a linear displacement, an angular 
displacement, and the derivatives thereof such as velocity, acceleration, 
and the like. The operation of system 800, according to data received from 
movement detector 814, is described herein below in connection with 

30 Figures 25A, 25B, 25C, 26A, 26B and 26C. 
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Light valve elements are components, which have an ability to 
influence light in at least one way. Some of these ways are, for example: 
scattering, converging, diverging, absorbing, imposing a polarization 
pattern, influencing a polarization pattern which, for example, may be by 

5 rotation of a polarization plane, influencing wave length, diverting a beam's 
direction for example by using digital micro-mirror display (also known as 
DMD) or by using field effect, Influencing phase, interference techniques, 
which either blocks or transfers a portion of beam of light and the like. 
Activation of light valve elements, which are utilized by the present 

10 invention, can be performed either electrically, magnetically or optically. 
Commonly used light valve elements are liquid crystal based elements, 
which either rotate or create and enforce a predetermined polarization 
axis. 

In the present example, multiple aperture 804 includes two 

15 apertures 802r and 802l. The controller 834 further activates the multiple 
aperture 804, so as to alternately open apertures 802r and 802l. In Figure 
20A, aperture 802r is open while aperture 802l is closed and in Figure 
20B, aperture 802r is closed while aperture 802l is open. 

Light rays, which reflect from various sections of the object 810, 

20 pass through the currently open aperture (802r in Figure 20A and 802t. in 
Figure 20B). Thereby, light rays 822 and 824 arrive from section 81 OA of 
object 810, pass through aperture 802r, and are detected by detection 
element 808A, while light rays 826 and 828 arrive from section 81 CD, pass 
through aperture 802r and are detected by detection element 808D. 

25 Hence, when aperture 802r is open, then the system 800 provides a right 
side view of the object 810. 

With reference to Figure 20B, when aperture 802l is open, light 
rays 827 and 825 arrive from section 81 OA, pass through aperture 802l, 
and are detected by detection element 808A, while light rays 821 and 823 

30 arrive from section 81 OD, pass through aperture 802l, and are detected by 
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detection element 808D. Thereby, the system 800 provides a left side view 
of the object 810. 

The illumination unit 830 is a multi-color illumination unit, which 
can produce light at a plurality of wavelengths. The controller 834 provides 
5 a sequence of illumination commands to the illumination unit 830, so as to 
produce a beam at a different predetermined wavelength, at each given 
moment. In the present example, the illumination unit is a red-green-blue 
(RGB) unit, which can produce a red light beam, a green light beam and a 
blue light beam. It is noted that illumination unit 830 can be replaced with 

10 any other multi-color illumination unit, which can produce either visible 
light, non-visible light or both, at any desired wavelength combination 
(CYMK and the like). 

Furthermore, illumination unit 830 can be a passive unit, where it 
receives external commands to move from one wavelength to another, or 

16 it can be an active unit, which changes wavelength independently and 
provides an indication of the currently active wavelength to an external 
controller. IJIumtnation unit 830 of the present example is a passive unit, 
\NU\ch enhances the versatility of the system 800, by providing any 
wavelength sequence on demand. 

20 The image detector 812 includes a plurality of detection 

elements 808A, 808B, 808C and 808D. In accordance with one aspect of 
the invention, detector 812 is a full range color detector, where each of the 
detection elements is operative to detect light in a plurality of wavelengths. 
In accordance with another aspect of the invention, the detector 812 is a 

25 color segmented detector, where the detection elements are divided into 
groups, each operative to detect light in a different range of wavelengths; 
One conventional type of such detectors Includes a full range detection 
array, which is covered by a color filter layer, where each detection 
element is covered by a different color filter. Accordingly, some of the 
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detection elements are covered with red filters, others are covered with 
green filters and the rest are covered with blue filters. 

The present invention enhances the color resolution of systems, 
using such color detectors. It will be appreciated by those skilled in the art 
5 that a color segment detector of poor quality may exhibit a wavelength 
(color) overlap between the different detection elements. For example, 
when the filters are of poor quality, their filtering functions tend to overlap 
such that the red filter also passes a small amount of either green or blue 
light. Hence, the detection element behind the red filter, also detects that 
10 small amount of green or blue light, but provides an output measurement 
as a measurement of red light. Hence, the color detector produces an 
image, which includes incorrect measurements of red light (e.g. more than 
the actual red light, which arrived at the detector) as result of that overlap, 
^ti Accordingly, received information of the inspected object is not valid. 
^5 15 In the present invention, the illumination unit 830 produces a 

'0 sequence of non-overlapping illumination beams at predetermined 

iij wavelengths (i.e., red, blue and green). As explained above, the color 
T detector cletects an image, which includes incorrect measurements, as a 

% result of the wavelength (color) filtering overlap. Since the Illumination unit 

W 20 830 and the image acquisition process are synchronized, the imaging 
O system can process each of the acquired images, according to the actual 
light beam color, which was produced therewith. For example, the 
illumination unit 830 produces blue light illumination beam. At the same 
time the color detector detects an image, which also includes actual light 
25 measurements in detection elements, which are covered with green and 
red filters, due to the wavelength overlap. The imaging system can discard 
light measurements, which are received from detection elements, covered 
with color filters, which are not blue (e.g., red and green). 

Such sequenced color illumination of the object, provides 
30 enhanced color resolution, for color image detectors of poor quality, and 
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obtains the valid color images of the inspected object. System 800 can 
further include a stereoscopic display unit {not shown), connected to 
controller 834 for displaying a stereoscopic image of object 810. 
Reference is now made to Figure 21A, which is a schematic illustration of 

5 a timing sequence, in which controller 834 (Figure 20A) synchronizes the 
operation of illumination unit 830, apertures 802l and 802r, and image 
detector 812. Signal 840 represents the timing sequence of the left 
aperture 802l. Signal 842 represents the timing sequence of the right 
aperture 802r. Signal 844 represents the timing sequence of the blue light 

10 beam, produced by the illumination unit 830. Signal 846 represents the 
timing sequence of the green light beam, produced by the illumination unit 
830. Signal 848 represents the timing sequence of the red light beam, 
produced by the illumination unit 830. Signal 841 represents the timing 
sequence of the image detector 812, where each image is downloaded 

15 therefrom. 

Timing sequence 841 rises every time any of the rises of 
sequences 844, 846 and 848 intersect with a rise of either sequence 842 
or sequefice 840. For example, rise 841a indicates a frame download of a 
blue light - right aperture combination, rise 841b indicates a frame 

20 download of a green tight - right aperture combination, and rise 841c 
indicates a frame download of a red light - right aperture combination. 
Similarly, rise 841 □ indicates a frame download of a blue light - left 
aperture, combination, rise 841 e indicates a frame download of a green 
light - left aperture combination and rise 841 f indicates a frame download 

25 of a red light - left aperture combination. 

It Is noted that for some light sources, the produced light beams 
do not cover the full range of visible light. For such light sources, the 
missing color components can be reconstructed (interpolated) taking into 
consideration the physiological assumption, that color reflection response 

30 as a function of reflected angle, does not change much with angle. 
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Reference is further made to Figure 22, which is a schematic 
illustration of a method for operating system 800 of Figure 20A and 20B, 
operative in accordance with another preferred embodiment of the present 
invention. In step 870, a sequence of illumination beams at predetermined 
wave-lengths is produced. With reference to Figures 20A and 20B, 
controller 834 provides a sequence of illumination commands to the 
illumination unit 830, which in turn produces different wavelength light 
beams, generally referenced 832, at predetermined points In time, towards 
an object, generally referenced 81 0. 

In step 872 right and left apertures are alternated. Light rays, 
which reflect from various sections of the object 810, pass through the 
currently open aperture {802r in Figure 20A and 802l in Figure 20B). With 
reference to Figures 20A and 20B, controller 834 provides a sequence of 
operating commands to the apertures 802l and 802r. 

In step 874, a plurality of frames, each for a selected aperture 
and wavelength combination is detected. Controller 834 operates the 
image detector so as to detect a plurality of frames, each respective of a 
selected aperture and wavelength combination. 

Light rays 822 and 824 (Figure 20A) amve from section 81 OA of 
object 810, pass through aperture 802r, and are detected by detection 
element 808A, while light rays 826 and 828 arrive from section 81 OD, pass 
through aperture 802r and are detected by detection element 808D. It is 
noted that in the present example, an imaging element (not shown) is 
introduced in the vicinity of multiple aperture 804. Hence, when aperture 
802r is open, then the system 800 provides a right side view of the object 
810. 

Light rays 827 and 825 (Figure 20B) arrive from section 81 OA, 
pass through aperture 802l and are detected by detection element 808A, 
while light rays 821 and 823 arrive from section 81 OD, pass through 
aperture 802l and are detected by detection element 808D. Hence, when 
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aperture 802l is open, then the system 800 provides a left side view of the 
object 810. 

With reference to Figure 21A, rise 841a provides a right side blue 
image (reference 806^b of Figure 20A), rise 841b provides a right side 
green image (reference 806'^g of Figure 20A), and rise 841c provides a 
right side red image (reference 8G6^r of Figure 20A). Similarly, rise 841 p 
provides a left side blue image (reference 806'-b of Figure 20B}, rise 841 e 
provides a left side green image (reference 806^g of Figure 20B), and rise 
841 F provides a left side red Image (reference 806'-r of Figure 20B). With 
reference to Figures 20A and 20B, image detector 812 detects the plurality 
of frames, and provides right and left output video for Image processing. 

In step 876 a stereoscopic color image from the plurality of 
frames, according to their aperture origin Is produced. With reference to 
Figure 20A and Figure 20B, the controiier 834 stores the detected images 
in storage unit 836. Image processor 838 retrieves the detected images 
from the storage unit 836, and constructs color stereoscopic images. 

Hence, the present invention provides an additionai way for 
detecting' a color stereoscopic image, using a single image detector for 
both sides and all colors. 

Reference is further made to Figure 218, which Is a schematic 
illustration of another timing sequence, in which controller 834 (Figure 
20A) synchronizes the operation of illumination unit 830, apertures 802l 
and 802r, and Image detector 812. Signal 840' represents the timing 
sequence of the left aperture 802l. Signal 842' represents the timing 
sequence of the right aperture 802r. Signal 844' represents the timing 
sequence of the blue light beam, produced by the iliumination unit 830; 
Signal 846' represents the timing sequence of the green light beam, 
produced by the illumination unit 830. Signal 848' represents the timing 
sequence of the red light beam, produced by the illumination unit 830. 
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Signal 841' represents the timing sequence of the image detector 812, 
where each image is downloaded therefrom. 

Timing sequence 841' rises every time any of the rises of 
sequences 844', 846' and 848' Intersects with a rise of either sequence 

5 842' or sequence 840'. For example, rise 841 'a indicates a frame 
download of a blue light - right aperture combination, rise 841 'b indicates a 
frame download of a blue light - left aperture combination and rise 841 'c 
indicates a frame download of a green light - right aperture combination. 
Similariy, rise 841 indicates a frame download of a green light - left 

10 aperture combination, rise 841 'e indicates a frame download of a 
red light - right aperture combination and rise 841 'f Indicates a frame 
download of a blue light - left aperture combination. 

Reference is now made to Figure 23, which is a schematic 
illustration of a timing scheme, for operating system 800 of Figures 20A 

15 and 20B, in accordance with a further preferred embodiment of the 
present invention. Signal 850 represents the timing sequence of the left 
aperture 802l, Signal 852 represents the timing sequence of the right 
aperture S02r. Signal 854 represents the timing sequence of the blue light 
beam. Signal 856 represents the timing sequence of the green light beam. 

20 Signal 858 represents the timing sequence of the red light beam. Signal 
851 represents the timing sequence of the image detector 812, where 
each image is downloaded therefrom. As can be seen in Figure 23, the 
timing scheme is asymmetric, where the green light beam is activated for a 
time period which is twice the time period of either the red light beam or 

25 the blue light beam. Signal 851 corresponds to this arrangement and 
provides a green image download rise (references 851b and 851 e). after a 
time period which is twice as long with comparison to red image download 
rises (references 851 c and 851 p) or blue Image download rises 
(references 851a and 851 d). 
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Reference is now made to Figure 24, which is a schematic 
illustration of a timing scheme, for operating system 800 of Figures 20A 
and 20B, in accordance with another preferred embodiment of the present 
invention. Signal 860 represents the timing sequence of the left aperture 
802l. Signal 862 represents the timing sequence of the right aperture 
802r. Signal 864 represents the timing sequence of the magenta light 
beam. Signal 866 represents the timing sequence of the yellow light beam. 
Signal 868 represents the timing sequence of the cyan light beam. As can 
be seen in Figure 24, the timing scheme addresses an alternate 
wavelength scheme and is also asymmetric. 

It is noted that a mechanical multi-wavelength illumination unit 
such as described in the prior art, can be used for implementing the 
present invention. However, such a system significantly reduces the 
capability of the user to control illumination duration, wavelength ratio and 
detection timing, such as described herein above. 

It will be appreciated by persons skilled in the art that the 
present invention is not limited to what has been particularly shown and 
described here In above. Rather the scope of the present invention Is 
defined only by the claims which follow. 
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CLAIMS 



Stereoscopic device comprising: 

at least two apertures, each said apertures including a light 

valve, each said light valves being operative to open at a 

different predetermined timing; 
a multi wavelength light sensor array, and 
a controllable multi wavelength illumination unit, producing at 

least two alternating beams of light, each said beams of 

light characterized as being in a different range of 

wavelengths, 

wherein said multi wavelength light sensor array detects a 
plurality of images, each said images corresponding to a 
predetermined combination of an open state of a selected 
one of said light valves and a selected one of said at least 
two alternating beams of light. 

The' stereoscopic device according to claim 1, wherein said multi 
wavelength light sensor array Includes at least two groups of sensors, 
wherein the sensors of each said group detect light in a different 
range of wavelengths. 

The stereoscopic device according to claim 1, wherein said 
muItl-wavelength light sensor array includes a plurality of sensors, 
each said sensors detecting light In a predetermined range of 
wavelengths. 

The stereoscopic device according to claim 1, wherein said 
controllable multi wavelength illumination unit surrounds said 
apertures. 
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5. The stereoscopic device according to claim 1, wherein said 
controllable multi wavelength illumination unit directs light aside from 
said apertures. 

5 

6. The stereoscopic device according to claim 1, wherein said 
controllable multi wavelength illumination unit comprises: 

a multi wavelength light source; 

a light dispersing unit; and 
10 tight guiding means connected between said multi wavelength 

light source and said light dispersing unit, thereby guiding 
light from said multi wavelength light source to said light 
dispersing unit. 

15 7. The stereoscopic device according to claim 6, wherein said light 
dispersing unit surrounds said apertures. 

8. The' stereoscopic device according to claim 1, wherein said light 
illuminating unit produces at least two alternating beams of light, each 

20 said beams of light characterized as being in a different range of 

wavelengths. 

9. The stereoscopic device according to claim 1, further comprising a 
controller connected to said light valves, said multi wavelength light 

25 sensor array and to said controllable multi wavelength illumination 

unit, said controller timing the operation of said light vaives, said multi 
wavelength light sensor array and said controllable multi wavelength 
illumination unit. 
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10. The stereoscopic device according to claim 1, further comprising 
capture means, connected to said muiti wavelength light sensor 
array, for capturing data received from said multi wavelength light 
sensor array. 

5 

11. The stereoscopic device according to claim 10, further comprising a 
storage unit for storing said captured data. 

12. The stereoscopic device according to claim 9, further comprising a 
10 stereoscopic display unit, connected to said controller, for producing 

said images. 

13. The stereoscopic device according to claim 1, wherein each said 
% different ranges of wavelengths associated with said multi wavelength 
% 15 illumination unit, is selected from the list consisting of: 

fi substantially visible red color light; 

i 7;'"; 

ry substantially visible green color light; 

'T' 'substantially visible blue color light; 

5^ substantially visible cyan color light; 

y 20 substantially visible yellow color light; 

D substantially visible magenta color light; 

substantially infra-red light; 

substantially ultra-violet light; and 

visible light. 

25 

14. The stereoscopic device according to claim 2, wherein each said 
different ranges of wavelengths, associated with said sensors, is 
selected from the list consisting of: 

substantially visible red color light; 
30 substantially visible green color light; 
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substantially visible blue color light; 
substantially visible cyan color light; 
substantially visible yellow color light; 
substantially visible magenta color light; 
substantially infra-red light; 
substantially ultra-violet light; and 
visible light. 

15. The stereoscopic device according to claim 1, wherein said muiti 
wavelength light sensor array is a color red-green-blue (RGB) sensor 
array. 

16. The stereoscopic device according to claim 1, wherein said multi 
wavelength light sensor array is a color cyan-yetlow-magenta-green 
(CYMG) sensor array. 

17. The stereoscopic device according to claim 1, further comprising an 
image processing system connected to said multi wavelength light 
sensor array and to said controllable multi wavelength Illumination 
unit. 

18. The stereoscopic device according to claim 1, further comprising a 
motion detector detecting the movement of said multi wavelength 
light sensor array and said apertures. 

19. The stereoscopic device according to claim 18, further comprising an- 
image processing system connected to said multi wavelength light 
sensor array, said controllable muiti wavelength illumination unit, said 
apertures and said motion detector. 
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20. Method for detecting a stereoscopic image comprising the steps of: 
alternating between at least two apertures, directed at an object; 
producing a sequence of at least two illumination beams, at different 
5 ranges of wavelengths; and 

detecting a plurality of frames, each for a combination including a 
selected one of said apertures and at least a selected one of 
said beams. 

10 21. The method according to claim 20, further comprising the step of 
reconstructing a stereoscopic image from said frames. 



-46- 



ABSTRACT 

Stereoscopic device including at least two apertures, each including a 
light vafve, a multi wavelength light sensor array and a controllable multi 
wavelength illumination unit, producing at least two alternating beams of 

5 light, each of the beams of light Is characterized as being in a different 
range of wavelengths, wherein each light valve is operative to open at a 
different predetermined timing and wherein the multi wavelength light 
sensor array detects a plurality of images, each of the images 
corresponding to a predetermined combination of an open state of a 

10 selected one of the light valves and a selected one of the modes. 
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name; that 

i verily believe I am the original, first and sole inventor {if oiily one name is listed below) or a joint inventor (ifplural invenlort; are 
named below) of the subject matter which is claimed and for which a patent is sought on th&.invention entitled: OPTICAL DEVICE 

The spccifieation of which 
a* S is attached hereto 

b. □ was filed on as application sertai no. and was amended on {if applicable) (in the case of 

a PCT-filcd application) described and claimed in international no. filed and as amended on (if any) 

wliich I have reviewed and for which I solicit a United States patent. 

I hereby state lhat I have reviewed and understand the conlents of the above-identitlcd spccitlcation, including the claims, ay amended by 
any amendment referred to above. 

I acknowledge the duty to disclose information which is jnatcri^il to tlic patentability of this application in accordance with Title 37, Code of 
Federal Regulations, J U6 (attached hereto). ( 

I hereby claim foreign pnorily benefits under Title 35, United States Code, § 1 i 9/365 of any foreign appl[cation(s) for patent or inventor's 
certificate listed below and have also identified below any foreign application for patent or inventor's certificate having a filing date before 
that of the application on the basis of which priority is claimed: • 



ffi a. iSI no such applications have been filed. 

b. n such <ipplications have been filed as follows: 



FOREIGN 


f APPLICATrONfS), IF ANY, CLAIMING PRIORITY UNDER 35 USC: § 1 19 


COUNTRY 


APPLICATION NUMBER 


DATE OF FILING 
(dav, month, year) 


DATE OF ISSUE 
(day, month, year) 










ALL FOREIGN APPLICATION(S>, IF ANY, FILED BEFORE I HE PRIORITY APPLICATION(S) 


COUNTRY 


A1»E»LICATI0N NUMBER 


DATE OF FILING 
(dav, month, year) 


DATE OF ISSUE 
(day, Qionthf year) 








: < 1 1 1 — 1 . ( 



I hereby claim the benefit under Title 35, United Stales Code, § 1 20/365 of any United States and PCT international applicalion{s) listed 
below and, insofar as the subject matter of each of the claims of Ihia application is not disclosed in the prior United Slates application in Ihe 
matnter provided by the fn-st paragraph of Title 35, United Stales Code, § 1 12, 1 acknowledge tiic diit\' to disclose material information a^; 
defined in Tnh 37, Code of Federal Regulations, § L56(a) which occurred between the filing date of the prior application and the national 
or PCT international filing date of this application. 



US. APPLICATION NUNIBER 


DATE OF FILING (day, month, year) 


STATUS (patented pending^abimdoned) 

I- 


09/257,850 


25/02/1999 (25 February 1999) 


Pending 



1 hereby claim the benefit under J'itle 3 5, United States Code § I t9(e) of any United States provisional applieation(s) listed below: 



' V,S. PROVISIONAL APPLICATION NUMBER 


DATE OF FILING (Day, Month, Year) 







I liereby appoint Ehe following attorney(s) and/f>r patent agent(s) to prosecute tliis application and to transact all business in the Patent and 
Tradeinark ollice connected herewith: 



Albrccht, John W.- Reg. No. 40,481 
Anderson, Gregg 1,- Keg. No. 28,828 
AnsemSj Gregory M. - Reg. No. 42,264 
Batzli, Brian H, - Reg. No. 32,960 
Beard, John L. - Reg. No. 27,61 2 
Herman, Charles - Reg- No. 29^49 
Black, Bruce E. - Reg. No, 41,622 
Blasdell, Thomas L. - Reg. No. 3 1,329 
Bogucki, Raymond A - Reg. No. 17,426 
Bniess, Steven C. - Reg. No. 34,130 
Byrne, Linda M. - Reg. No, 32,404 
Carlson, Alan G. - Reg. No. 25,959 
Carter, Charles - Reg. No. 35,093 
Caspers, Philip P. - Reg. No. 33,227 
Chiapetta, James R. - Reg, No. 39,634 
Clifford, John A, - Reg. No. 30,247 
Cochran, William W, - Reg. No. 26,652 
Daignault, Ronald A. - Reg. No. 25,968 
Daley, Dennis R. - Reg. No, 34,994 
Dalglish, Leslie E. - Reg. No, 40,579 
Daulton, Julie R. - Reg. No. 36,4 14 
DeVries Smith, Katherine M. - Reg. No. 42,157 
DiPietro, Mark J. - Reg. No. 28,707 
Edell, Robert T. - Reg. No. 20,187 
Epp Ryan, Sandra - Reg. No. 39,667 
Farber, Michael B. - Reg. No. 32,612 
Funk, Steven R. - Reg. No, 37,830 
Glance, Robert J. - R^. No. 40,620 
Golla, Charles E. - Reg. No. 26,896 
Gorman, Alan G. - Reg. No. 38,472 
Gould, John D.^- Reg, No. 18,223 
Gregson, Richard - Reg. No. 41,804 
Gresens, John J. - Reg. No. 33,1 12 
Hamre, Curtis B. - Reg. No. 29,1 65 
Hillson, Randal] A, - Reg. No. 31,838 
Holzer, Jr., Richard J. - Reg. No. 42,668 
Johnston, Scolt W, - Reg. No, 39,721 
Kastelic, Joseph M. - Reg. No. 37,160 
Kettelbcrger, Denise - Reg. No. 33,924 
Knearl, Homer L. - Reg. No. 21,197 
Komanduri, Janaki - Reg. No. 40,684 
Kowalchyk, Alan W. - Reg. No. 3 1 ,535 
Kowalchyk, Katherine M. - Reg. No. 36,848 
Kubota, Glenn M. - Reg, No, 1M4,197 



Lacy, Paul E. - Reg. No. 38,946 
Larson, James A. - Reg. No. 40,443 
Liepa, Mam H. - Reg. No. 40,066 
Lindquist, Timothy A. - Reg. No. 40,701 
Lynch, David W. - Reg. No. 36,204 
Marschang, Diane L, - Reg. No. 35,600 
McDaniel, Karen D. - Reg. No. 37,674 
McDonald, Daniel W, - Reg. No. 32,044 
Mclntyre, lain A, - Reg. No. 40,337 
McKenzie Denise L. - Reg. No. 1M3,790 
Mueller, Doug3as P. - Reg. No. 30,300 
Nasicdlak, Tyler L. ■ Reg. No. 40,099 
Nelson, Albin J. - Reg. No. 28,650 
Parker, Sandra M. - Reg. No. 36,233 
Pauiy, Daniel M, - Reg. No. 40,123 
Phillips, John B. - Reg. No. 37,206 
Plunkett, Theodore - Reg. No. 37,209 
Pytel, Melissa J. -Reg. No. 41,512 
Reich, John C. Reg. No. 37,703 
Rciland, Earl D. - Reg. No, 25 J67 
Rittmaster, Ted R. - Reg. No. 32,933 
Schmaltz, David G. - Reg. No. 39,828 
Schulman Mark D. - Reg. No. 31,197 
Schumann, Michael D. - Reg. No. 30,422 
Sebald, Gregoiy A. - Reg. No. 33,280 
Skoog, Mark T. - Reg. No. 40,178 
Soderberg, Richard - Reg. No, P-43,352 
Smnner, John P. - Reg. No. 29,1 14 
Sumners, John S. - Reg. No. 24,2 16 
Tellekson, David K. - Reg. No. 32,3 14 
Trembath, Jon R. - Reg. No. 38,344 
Underhill, Albert L. - Reg. No. 27,403 
Vandenburgh. J. Derek - Reg. No. 32,179 
Vradenburgh, Anna M. ^ Reg. No.39,g68 
Welter, Paul A, - Reg. No. 20,890 
Whipps, Brian - Reg. No. 43,26 1 
Wickliem, J. Scot - Reg. No. 41 ,376 
Williams, Douglas J. - Reg. No. 27,054 
Witt, Jonelle - Reg. No. 41 ,980 
Wood, Gregory B. - Reg. No. 28, 133 
Wood, William J. - Reg. No. 42,236 
Xu,Min S. "Reg. No. 39,536 



1 hereby authorize them to act and rely on insti'uctions from and communicate directly with the pei son/assignee/attorney/firm/ 
organization who/which first sends/sent this case to them and by whom/which 1 hereby declare t!iat 1 have consented after lull 
disclosure lo be represented unless/unti] I instruct Merchant, Gould, Smith, Edell, Welter & Schmidt to the contrary. 

Please direct all correspondence in this case to Merchant, Gould, Smith, Edell, Welter & Schmidt at the address indicated 
below; 



Merchant, Gould, Smith, Edell, 
Weher & Schmidt 
3200 IDS Center 
80 South 8th Street 

Minneapolis, Minnesota 55402 



f hereby declare that ail statements made herein of niy own knowledge are true and that all statements made on information and 
belief are believed to be true; and further that these statements were made with the kjiowledge that willful false statements and 
the iike so made are punishable by fine or imprisonment or both, under Section 1001 of Title 18 of the United States Code and 
that such wiUful false statements may jeopardize the validity of the application or any patent issued thereon. 



1 


Full Name of 
Inventor 


Family Name 
GOLDSTEIN 


First Given Name 
MICHAEL 


Second Given Name , 


0 


Residence Sc. 
Citizenjihip 


City 
Ilerzetla 


State or Foreign Country 
Israel 


Country of Citi7.enship 
United States 


1 


Post Office 
Address 


Post Office Address 
4 Klausner Street 


City 
Herzelia 


State & Zip Code/Country 
Israel 46683 


.Signature of Inventor 201: 


Date; 


2 


Full Name of 
Inventor 


Family Name 
YARON 


First Given Name 
ABRAHAM 


Second Given Name 




Residence & 
Citizcn<;hLp 


City 

Givataim 


State or Foreign Country 
isruel 


Country of Citizenship > 
Israel 


2 


Post Office 
Address 


Post Office Address 
45 Shenkin Street 


City 

Gtvataim 


State & Zip Code/Country 
Israel 532<)3 


Sijsnature of Inventor 202: 


Date: 


2 


Full Name of 
Inventor 


FumiJy Name 
GHLLAI 


First Given Name 
SHAY 


Second Given N^ime 


0 


Residence & ^ 
Citizenship 


City 
Tel Aviv 


State or Foreign C'ountry 
Israel 


Country of Citizenship 

Israel | 




Post Office 
Address 


Post Office Address 
55a Ir Shcmcsh Street 


City 
Tef Aviv 


State St Zip Code/Country 
Israel 


Signature of Inventor 203: 




Date: 

.. 



§ 1.56 Duty to disclose informjition material to patent:*biltty. 



(a) A patent by its very nature is affected with a public interest. I'he public interest is best sci-vcd, and the most elective 
patent examination occurs when, at the lime an application is being examined, the Office is aware of and evaluates the teachings of ail 
information material to patentability. Kach individual associated with the filing and prosecution of a patent application has a duty of candor 
and good faith in dealing with the OiTice, vvhich includes a duty to disclose to the Office all inforniation known to that individual to be 
material to patentability as defined in this section. The duty to disclose information exists with respect to each pending claim until the claim 
is caiicclcd or withdrawn from consideration, or the application becomes abandoned, hiformation material to the patentability of a claim that 
is canceled or withdrawn from i^onsideration need not be submitted if the infoi mation is not material to the patentability of any claim 
rcmainin under consideration in the application. There is no duty to submit inlbrmation which is not material lo the patentability of any 
existing claim. The duty to disclose all information known to be material to patentability is deemed to be satisfied if all information known 
to be materi^^ to patentability of any claim issued in a patent was cited by the Office or submitted to the Office in Che manner prescribed by 
§§ l.97(b)-(d) and 1.98, However, no patent will be granted on an application in connection whh which fraud on the Office was practiced or 
attempted or the duty of disclosure was violated through bad faitli or intentional misconduct, The Onice encourages applicants to cai'cfully 
examine; 

{!) prior art cited in search reports of a foreign patent office in a counterpart application, and 

(2) the closest information over which individiials associated with the filing or prosecution of a patent application 
believe ajiy pending claim patenlably defines, to make sure that atiy material information contained therein is disclosed to the Ol'iice. 

(b) Under this section, inforjnation is material lo patentability when it is not cumulative to information already of record or 
being made of record in the application, and 

(!) It establishes, by itself or in combination with other itiformation, a prima lacic case of unpatentability of a claim; 

or 

(2) It refutes, or is inconsistent with, a position the applicant takes in: 

(i) Opposing an argument of unpatentability relied on by the Office, or 

(ii) Assoling an argument or patentability. 

■i 

A prima tacic case of unpatentability is established when the information compels a conclusion that a claim is unpatentable under the 
pjcpondcrance of evidence, burden-ot-proof standard, giving each term in the claim its broadest reasonable conj^ruction consistent with the 
specification, and before any consideration is given to evidence ^vhich may be submitted in an attempt to establish a contrary conclusion of 
patcntabilit>'. 

(c) Individuals associated with the filing or prosecution of a patent application within the meaning of this section arc: 
{ 1 ) Each Inventor named in the application: 

(2) Each attorney or agent who prepares or prosecutes the application; and 

(3) Every other person who is substantively involved in the preparation or prosecution of the application and who is 
associated with the inventor, with the assignee or with anyone to whom there is dn obligation to assign the 
application. 

(d) Individuals other than the attorney, agent or inventor may comply with this section by disclosing iufortnatioii to the 
attorney, agent, or inventor. 



